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-: The Student Observation: of Teachers and Teaching: 

‘Techniques instrument (StOTT). vas developed by high school students. 
who: served on the Student Advisory Boar¢@to. the Pennsylvania “P 
Lepartsent of Education. The StOTT instru#ent consists of 32 items. 
‘Bach of ‘the first 29. is ‘included in. one of the subscales: 
Teacher-Student Relations,. Grades and Testing, Materials, Teacher 
.Férsonality,° and. Teaching Methods and Techniques. The final three 
iteas ask’ students to give their opinions about whether or not the 

“ teacher. they are rating has any distracting personal mannerisms, to 
give the reason they took the teacher's course, ‘and to tell whether 
_ they vould recommend the course to another student. As reported in 
the Educational Quality Assessment manual , Mertaog., 1976) this |": 
instrament has evidenced an internal consistency reliability of*. 86. . 
As evidences of validity significant correlations have been found , 
with such‘variables as the nuab ot books-read by students, the 

, Bumber of days they were truant, and their‘ desires to quit school 
 eieeen Shannon and Reardon, 1975) SoA copy of the Student 
Bservation of Teachers test (version 2). $5 appended. (Author/AV) 
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, ' Doctiments “acquired by ERIC include many informal anpublished .* 
- , * gaterials not avaidable, from cther sources, ERIC makes every effort * 
——s-torebtain the best copy “available. ‘Nevertheless, items of marginal * 

' * reproducibility are ofttn | encountered and this affects the quality oe 
[* of ‘the sicrcfiche and hardcopy reprogwttions ERIC makes available * - 
‘e’via the ERIC Document Reproduction S@rvice (EDRS): ®DBS is not w °* 
* responsible for. the’ quality of the original docurnent. Reproductions * 

. * supplied by EDRS are the best that can ‘be aade ‘frog the original. e+.) , 
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, ' This* study, was veterans ‘to fngsabtoatn the seaeanctasey and validity of af 

.) instrument designed to provide student feedback to high school teachers about their , 
methods. The instrument examined, the Student Observation of Teachers and Teaching. "eo 

* Techniques, Instrument (StOTT), was developed by high ‘school students who: served on : 
_the Stadent, Advisory Board to the Secretary of Rducation of Pennsylvan{a. ‘ 


aes 4 ancluded’ “tn he study were 925 ‘high school students and 36 anche: ther . 
variablea’ were colnet alorg with StOIT ratings as @ meang of. investigating. their 
_ influence. ° ‘= . . mie 


. ’ * ¢ 4, 
“iepatel ias? gathered in the stidy for scoring the stort in terms of five | 
‘“* gubscales. Student ratings.of teachers were “found to be highly stable over an ~, 

_ interval of one motith. The instrument seemed to be capable of measuring ways in) - 
a9 which’ Students felt that their teachers djffered from each other. The finding ‘that .. ° 
_‘dtudent ratings appeared tq be infiuenced by ‘such factors as, student attitudes toward. 
school and teachers and student success in school i icated that the instrument should’ . . 


\ 
° 


e.. not be used to evaluate and compare teachers. . Howevér, thd-instrument- seas tobe “ay 
——--— valuable one for use within individual teachers’ classrooms. 
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i hoes oo . Introduction - ‘ . : ; a. 
Tt. , . . Pr . wa 
“ % . ° oe . . o, 
. Probably most, "high sthool téachers have at one time'or another made some— . 


“\ attempt to gather -Atudent’. -opinions about thelr ‘teaching nethoda. . Teachers: whg*have 

‘ * used student Feedback instrumente: would generally-agrée that information ‘collected in .- 
* vthis: way “is valuable to them. Hayes, Keim and Neiman (1967), for exariple, reported. | 

an - ‘that over 90 per cent of the high school teachers in their: study~ believed thae useful . 

- 4's ¢ -Shformation was obtained, from the student feedback instrument they were asked .to use. 


a 


vs : *s _ But, how accurately. can ‘etudente 3 assess teaching, methods? “are student 
aan ratings of a tefcher’ FY techniques stable over time? De extraneous factors, such es . 
a student’ 8, grade ina teacher’ 8 course, inf lpence his or her’ ratings of the. teaches? , 
e e 
: Questipns such as .thése have been apked’ repeatedly in recent years by invest-  - 
‘ »  igators concerned @ith the reliability. and validity of instruments designed for use 
peo, at the college level. They have been asked’ mych lesa of fan’ about instruments designed 
* to be used by high school teachers, possibly “Yecause few attempts have been, made at, 
« this level to employ 6 such’ instruments as vehicles for evaluating ‘and | comparing ” ‘ 
teachers. ‘ . . ao, Ta 


sx to Cot * os 


at 


. Research which has been carried out at the nteé school level has produced  % 
conflicting ‘resulta. Onethe positive side a number’ of. investigators, {e. B+» Hayes, 
* Keim and Neiman (1966, 18673... Davidoff (1970), DeAmico (1973)} have ‘reported: results 
- “which indicated that, student ystings of teachers were -stable over time. Both‘in the . 
_ study carried out by, Hayes, Keim ‘and. Neiman: (1966) and in ‘that, performed by Veldman: -, 
» and’ “Peck, (1967) it was found that student ratings of, teachere had some aggeement “ 
, with ratings given. these sage teachers by their supervisors. Thothhpson (1974) 1 
uncovered no significant relationship between ratin 8.0f high achool - teachers and an 
' their students’. sex, grade level, grade-point average, expected curse grada or < 
fy degree of absenteeiam. Shaw (1973) concluded that ratings of high school teachers 
.e _ were not Unfluehced by the teacher's sex, academic degrees. or? years ‘of teaching . . 
~ experience, or by students‘ ‘grade-point average. . 
.. : . “y “N 
_s On, the e riegative side, however, a number of studies: have: indicated that student 
-.. +, vratings'of h -achool teachere, arée influenced, by fattors other than teachers' “ 
so, _ behavdors. For example, Smith and Brown '(1976) concluded that: students’ general: |e ¢ 
" attitudes toward te&thers,. their enjoyment of the, subject matter and the gYade they* 
‘gxpected to receive ell inflyenced ratings given 4 teacher. Jackson and Fuller 1966)" 
reported that female students perceived ‘teachers as more conf ident or poised thah did 
‘ male. students. They also found that, the socioeconomic dtatua of students and tenchere 
+ ' * geemed to influence ratings received’ by teacners. “Veldran and Peck (1967) found ‘that © 
student ratings of teachers varied as a function.of the subject area taught.. ‘Teachera 
teaching physical ‘education, home. ecorfomics .or business were. found to receive the- 
highest ratings. *. Those teactting’ foreign languages, mathematics ‘or science recbived ~, ° 
low ratings. (oe stale ‘ Me fe - oe v ° 
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The present ptudy was carried ied out, to examine the reliability —and—va: 
strument developed fo provide student feedback to high school ‘teachers about’; 
. their methods... Many of the same‘questions addressed in past investigations of student 
feedback instruments were asked as a means both of examining closely a specific , 
instrument .and of adding to existing "kngvledge about the use of such instruments ‘tn’ 
. high: echgols. oe - ww -~ 1. . 
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The Student Observation of Teachers and pesca r ’ 


Mg ¢ af Techniques ae : - 
€ @. . ‘ . . BS sy 
Description of the Instrument : ee OS 7 r oo 


. The instrument. examined in the study,« the Student Givecvaistan of Zeachoxe” 

: ‘ena Téaching Techniques instrument (StOTT), was developed by high school. students 
who served on the Student Advisory Board to the Pennsylvania Department of Edycation. 0: 
This Board, composed of eleVenth and twelfth grade student representatives from. all 7 

parts of Pennsylvania. was formed: to advise the Secretary’ of Education of student 
opinions abut Pennsylvania’ s educational syatem. , : fp tog 


ae 


The SCOTT instrument- consists of 32 items: Each of the first. 29 is suited 
in gone of five subscales. ‘The final thyee items ask students to give their: opinions 
about whether or not.the teacher they are Tating has any distracting persqnal> | 
mannerisms, tO gbve the reason they took the teacher's course and to tell whether 
they .would reco end the course ‘to, afother student. ee ee = 


"aay The first 29 items are positive statements about a teacher’ s classroom behav- 
tors (e.g., The teacher is’willing to help you when you need it)... For each of these 


9 “a five-point scale is provided for students-to mark their responses.’ The first, . 


Ny 


third and, fifth points af the scald are defined for the student. ,These are, in.the © 
majority of cases, seat A (1.e., Always, Sometimes, Never) but for certain items a— 


s Dra si different scale i's eaplayed. An example of such an item is the” following:. 


The ‘material on tests was server by the teacher prior to the test. ‘ 
sd , a8 .- * : 


‘9 . 


“s a oe ee ag Wey ROE a, OTe 
i : Thoroughly’ na is stan init Not at ALL” _ & 4% 
- ‘ cd “3 48 - 

When examining the reguibts of a “Wiasat = of him or ber a teacher. is ° 
encouraged, to look at both the results for ‘individual itemg and the freans obtained 
* on each of the subscales. These five substales are Teacher-Student Relations (6 , ~ 
~4tems), Grades and.Testing (6 items), Materials (3 items), Teacher Personality GB 


items) .and ‘Teaching Methods and echniques (11 items). . 

: “e@ ae : ag .* f . * ; . ' vt ‘ a 
‘ oz e ts to 
" Developaent of the Instrument , : : ‘ $ . 


The development of thie. StOTT was begun in October of 1973 | at tha first meeting © 
Of the Student Advisory Board. A Tenure/Teacher Evaluation Conmittee.was formed to 
“studythow students might help dmprove teaching. A decision was. made by this Commfttee’ 
to find or develop a student: observatioh of teachers instrument of proven worth. After 


; " examining a-number of questionnaires in use in the United States, thé Committee, 


. assisted by theit Department of Edycation advisers, began work~on the development seas 


: _ “of their own+instcument. This instrument, if proven to be of quality, would be made 
; ‘available to high school teachers who desived to obtain feedback from their students 
‘about the strengths and weaknesses of their methods. ; aT oe . a 
* pS > . ® ’ . ’ 
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e . 7 a . 7 . a 
He ‘By the ‘end “of the 1973-74 school year questions. for an instrument had been ,, 
written. These were taken into high school classrooms in nifie school districts to 
obtain student opinions about’them. Students were asked to examine the clarity and: 
appropriateness af*each question.’ Teachers and: administrators were also asked to 
.examine the instrument at this time. Revisions in wording’ and the deletion of, one 
question resulted from this tryout. — ss 


> 
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, ‘During the 1974-75 school year the" rev tiad dnatruméat was. feed ino in 
rooms again. This time students both reacted to.the appropriaténess dnd clarity of 
the-questions and indicated their observations about their -teachere. Again, the 

‘ wording of a number,of. questions was changed. -Some evidences of reliability and’ se 

‘validity were found in:this* tryout + oS > “,’ ‘ _ . rr 
Since the instrument now showed promise of detig a useful one it was decided 

that a large-scale study was needed to addins ‘further its a ‘arid ‘Validity. 


-The study described in a ak paper was Heulgned for ‘this -purpose.: ‘ . ° 
‘ he. ES ; a “ ee ~~ : 
is ag cal ‘Methodology of the Study .°. ne ‘ 
1 . . s . ‘ . . id 
"Sample roe : . f° ae tor hae as ? a bh 


' 
. ° 


oe. 
, 


‘ 


.e’ | The study was:carried out during the 1975-76 school year. In all, 36 teachers ny 


participated, some of whom were rated by more than one class. A total of ‘925 tenth,, 
eleventh and twelfth gr. -students from 45 classes and five. . school's were included 
in the study. Two of th schools were suburban, two were rural and one was 2 


vocational-technical school. - F ® a es cae 
¥ 


Design. ~ Ce * i F 


ag Oek ‘ 

As a means of obtaining as much ingormat jo oh as' possible from the tryout 
‘without ‘taking up a great deal of any teacher's HAstructional time, thr'ée distinct 
groups were ysed. ‘By. employing different procedures ‘and measurement instruments 
‘with each group it, was ie td ask a  vartety of. research qu meseny, about “the >> 
StOTT. r gel : . 


; é i . . 
« e% 


-” 


| Group 1 consisted of 18 teachers whose esas filled out “the Sto]T, waited : Ss 


a month, then filled out the “instrument again. In addition, these students answered ' 
a questionnaire giving information about themselves, including-their sex; grade, 
-level, curriculum, reason for taking the course and average grade both for the 
teacher's course and for their major courses. ‘This -group was used to examine both ! 
the stability over time of student ratings of the saihe teacher and the ‘influence * mae 
_ of extraneous factors upon student ratings dof .a teacher. . ‘ i 
é ad s 2 


Group 2 consisted of eight teachers, each of “whom ‘asked two of their classes : 


to. rate: hem: Both classes. ‘were of the same grade level dnd were taking the same 

" gubject - from the ‘teacher. Information was gathered in thig way on the-extent to 
which ratings “of a teacher were a function of the: particular. class chosen for the 

_ Yatdng fask. Such information would -be useful to teachers in interpreting the 
results of StOTT administrat{ons\ ae ue ; : oy 


fy 


e 
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; One of the. classes of ‘each Group 2 teacher was asked abso to fill out a 
; forced-choice version of certaig of ‘the items of the StOTT without looking at the - 
Ms _, Stott ratings they had given a‘teacher.. -This instrugent (shown in’ the, Appendix) 

» 77 was made up of four items from the feacher-Student Relations subscale and -four 

+ items fram the Methods subscale. Each of the Teacher-Student Relations items was 
’ * paired with each of the Methods ftemp, producing a total of 16 pairs, Students 

_ | responding tof thé instrument were asked to determine whtch statement of each pair 


> 


‘was more true of. the teacher ‘they were rating. A student's score.on the instrument ( 


was the number of times.he or shé had chasen a Teacher-Student Relations item over 


.,” ‘a Methods item. For the same 16 paire the same student's item scores on the StoTT 
. a* were examined. , The number of times. he or she had given a higher rating to a 
Teacher-Student Relations et than to a Methods’ item was ¢omputed (e.g., a rating: : 


of 5 on item 1 and a rating/of 4 on item 23, would be”counted in a,similar way to 


choosing item 1 over item 23 ina forced-choice pairing). Correlations of, students’ | 


scores obtained on the two instruments’ provided an index of stttents' abilities to 

make thoughtful judgments when rating teachers oh specific items of the StOTT. High 
woo oa ‘ correlations would indicate that, at least at the time of -the rating task, students, 

swere capable of making rather ‘fine judgments which had meaning to them. 
; y ry 4 y 


“e 


. | ‘The ‘other class of each Group 2 teacher responded to the instrument’ used in 
Pennsylvania's statewide assessment program (Educational Quality Assessment) to 
measure eleventh grade students’ A ope pea in School and Learning. The 37-item 

_ ‘instrument is made up of three subécales, measuring attitudes toward Learning, 


toward School and toward Teachers. AS reported in the Educational Quality Assessment 


manual (Hertzog, 1976) the ‘instrument has evidenced an internal consisténcy reliab- 

1 ditty of .86; the reliabilities of the Learning, School. and Teachers subscales have 

: ‘been. found to be, respectively, .60, .82 ang 70..." A8 evidences. of validity signi- 
+ 4 fieant correlations have Been, found with suth’variables as the*number of books read 


‘ by students, the number of days they were tryant and their desires to quit school, 


<7... (Masters,* Shannon and Reardon, 1975). Corredations of student cores on ‘the Interest 


in School and Learning instrument with their StOTT ratings were used to determine 

héw much influence students’ ganeral attitudes toward school and’ teachers had upon 

‘ their ratings of an individual teacher.. ae 7 is 

° ue" z “a a! 
Comparisons of the mean ratings given two teachers by the same class were carried 
out to learn if,-in fact, students were capable of using the StOTT to pick out what 


~. ‘they felt were specific strengths and weaknesses” of their teachers" methods..* If 
_ classes were found to give similar ratings to eac of their teachers, the worth: of 
-¢ thé StOTT instrument .would have to be seriously questioned. . \_ ' 
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Group 3 consisted of nine classes, each of which rated two of their teachersa 


‘ 


‘“ 


a . : ; - oe ae 2 
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, \ , Results a: 
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e \ : . . 
’ Reliability and “Independence | of the StOTT Subscales . . . . ¢ 


Before an examination of other questions about the StOTT could be attempted: - 
ar ‘some assurance was needed that.its subscales were reliable and relatively independent 
hw ‘ot each other. The aubscales were formed) on a conceptual basis, ‘by placing items of ~ 
like content, on the same subscale. Little empirical support had been gathered for 
gh this structuring, . ' \ v, ee tee : ‘ 
Thetefore, an item analysis was carried out using we from all 925 students 
who had fiTled‘ out the’ StOTT. ' Table 1 containsthe internal consistency ‘reliabflity 
coefficients (coefficient alphas computed for each of the sybscales. As shown, . . 
. reliabilities ranged from .51 (Materials) to,.80 (Teacher-Student Relations). Each 
‘item of the,instrument -correlated' more highly with 4ts own subscale than with any 
other subscale. The item analysia results, _ then, generally, supported the f ive- : 
subscale structure. Thé reliability of the: Materials gubscale, however, was somewhat’, 
. low Since’ the items included ‘on it did correlate with each other the relatively low 
reliability obtained © wotild.seem to indicate that more items: than the_ three ‘employed . 
are heeded to “provide: eee measure of this area., 


a eo. ‘A 


Also shown in Table J are the mean-item ratings given teachers in éach of the 


subscale areas. (A scale r from 1 to 5 was_employed in scoring veach item.) +» >, 
The highest ratings were given for the items of. the biog a subscalé and if 
the items of the Materials subscale. The. lowest Tatings were in assessing ™~ 4 
Teaching Methods and Techniqués. us K , ' oe 


a : 4 = a . ou F ee 
} Table.1 74 - ae ge ‘ . 


Reliabilitiés ‘bs ‘Mean Teen ‘ding Obtained for: ~- 
.Each StOTT Subscale 


Cae. .* KR? 
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Boy ; “No. of : ; Coefficient at ee" 
qt - Subscale. : Items Ratin : ha al a 
’ M.. ; a. sete an 


Teachér-Student Relations - 6 4.12 ..80 g - 

Grades and Testing™ - 6 ° 4,27 665. -° : : 

Materials. ’ 3 + 4.28) - SL ‘ ‘ 
& Teacher Pérsonality # 3 4.13 717 
Teaching Methods and ie 12 ; " aa 


Techniques 


- td provide information which was Scene, unique. 


Table.2 shows the eSereiaciine obtained atong the five. subBcale areas. “The F 
highest relationship between two subscales, .70, was, found for tlie correlation . 
between Teacher Personality and Teacher-Student Relations. The results summarized 

. by. Table 2, then, ‘also. supported the use of.the five subscales, “since each ‘Sipseeet, 
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Stability of Ratings Over Time , — 


- , 


we r . : ‘ 
Thus, support was gathered for icsetaes the StoTT in cekns of the. ‘conceptually 
based subscales,” Scores on tHese could therefore be used in further investigations 


of ‘the properties of the instrument. ~ 5 . 
: , 
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e 


. 


Included in Table 4 are correlat ioys summarizing the degree of stability found 
for student ratings over an interval’ of one month. Results for the total group of 
334 students who particip. ted in this phase’ of thé study and for two subgroups are’ . 
shown. It was believed ssiblp. that students experiencing learning difficulties in 
school might, because of lack of motivation,and inability to réad.well, produce 
ratings which had a degree of instability. , ‘Therefore, a comparison’ was made of the 


x stability of ratings given” prea ayeraging hrades of A or B in ‘their major’ 
a 


courses with that of student? dveraging grades of -C and below.. Finakly,; mean ratings 
given each of the 18 ‘teachers on the two Secastons ‘2 their. classes were age 
as an index of the stability of. these. , 7 : ios 


* . r 1 
. 


As Table 3 jndicates student: ratings. of the’ ‘same teacher did a a wank 
deal of stabéjity.over the one month interval.” vor “the total’group of students 
stability co cients for four of’ ‘the subscales were greater than..70; again, the 


* results for the Materials ,Subscale were lowest. Students earning grades of C and 


below in school did. not. appear -to give ratings which were any less stable than were 
those of students earning grades of A or’B. |Especiaily impressive were -the stability 
coefficients for the mean ratings given:each teache: by their classes. For all five ~ 


- subscales, coefficients of .75 or greater were computed and for Runes subscales these 


coefficients were greater than .96.° 4 
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aie Table 3 : ‘ 


A 


wen 3 -Le : 
: 3 Stability Coefficients for the StOTT. , me 


No. of . Teac ~-Stud. Grades - 


oc - . . ' é 
J+ Students Averaging Fi i i + : e : 
Grades of. C or ~ . . : : ; a 
‘Below . ,109 - . Be, .67 ° 60 78° .70 
. Students Averaging Fe ee MG TS _— “3 acer, 
Grades of A or B 208 679 179 (61: & 72" .73 
<osq ALL STUDENTS ° 334 emery {.) -76 "60 @ AS) STL: 
Mean Ratings Given to’ ras : 
“e 18° Teachers: ar * 93 “92 79 ot: ) re. 7 
os : e “+ ‘ : = 
2 3 ‘ % . F 
* ‘ . . Pag.) SP oe . e . rs 
Ability of Students to Make Meaningful lec isions 
% Rs 


’ As described’ in the Design sect on certain of the StOTT ‘Lrems were included 
in a forced-choice “instrument. ¢ Scores on this instrument were correlated with saotes 
obtadned for the same items of the StOIT. - Scoring was accomplished such that scores, 
on both: instryments reflécted the degvee to which a teacher was rated higher in 

*Teacher-Student Relations than in Methods, Table 4 contains correlations computed 
to examine the relationship betwéen acores obtained in the two ways. Results for 
, each of the sight‘chanses and for the total group are-shown, \ . 
. sim ad i) ee 
: _ As is evident ‘th Table 4, scores obtained on the two instruments agreed well 
_ >. with each ofiter for six of the eight. classes: and for the total group (one-tailed tests 
at the .05. level were: employed). Students, therefore, did appear in general to be 
¢ taking’ decisions about StOTT item ratings which had meaning to them. -When confronted 
with the same items in a different response format, students gave responses which were 
~ highly similar, €o those. had given using, the five-category StoTT scales. 


; Rasoxa © > Me H ‘ . bs e 
. ‘ re 2 - Table 4° “io. = 
Correlations Between StOTT Scores and Forced : 
a a : . Choice Instrument Seores hs S 
’ « P ’ > 
a & e * 3 js . 2 a . 
- aS . a Number of , ‘ : 
_ _° . 4 Class ~< Students . ° Correlations . : ‘y 
: » A 26 ; 22: = 
‘ B ‘19 ; .62%% 
‘ -C 28 ©. BLee 
-D 21 > ~ 72k* 
. E 9 : 59% ; 
F 23 . SSF x irae , 
G 26. « 87k Z 
ee H oe 784% ay 
# oe Fy Total Group Ee ti: .70%* + ° 
a . *Significant at beyond: the .05 level’ PS nh 
jon * , “‘**Significant at beyond the .01 ‘level aa . i ¢ 


° < . if 7 10 , : eas ‘ 


: 4 ig : . ; . . Be ue “ae é ae 
ni a Ratings of Tyo Zeachera by the Sane Class .« . “aN ig oe so 
ws . tow ‘ "* me 
; vate 5 shows, rather conclusively that the same class was g capable of usiog 
. the StOTT to pick out ways ‘in which they believed two of. their: teachers differed.”.” 
a Each of the nine clagses rated one of their teachers significantly higher than the 
other offe on at least one of ‘the fjve sukscales (correlated t values were computed, 
for*thege comparisons; two-tailed” tests ‘at the +05 level Bi performed). 
. of especial interest are thé results shown for the first two classes. These 
classes rated one of their teachers higher on the Grades and Testing’ subscale and 
: the other’ teacher higher on the Personality -substale. This -would seem to mean that 
these | lasses were not responding to some global feeling about their teachers but 
. : were, in fact, attempting to look at each StOTT item as a rating task-in and of F 
itself. ‘ : ts oe ‘ crete’, 


—-— o 


“ Ratings of- the Same Teacher by Two Classes . ; : 


“Table 6 sumfarizes the results” found in Garacing the ratings given the same: 
teacher by two classes. Two-tailed analyses of variance were carried out} F values’ 
for. the comparisons are shown. - . , « 

a 

The results contained in Table 6 drat oat that it is saouadivte for a teacher 
‘to be given different ratings by two similar classes, This occurred for three of 
the eight teachers. The fact’ that differences were found for only three teachers 
* would seem to suggest that the question asked is a complex one. The finding of 

dif ferences may;be a: function of the particular teachers and classes involved. A | 
much larger number of teachers than eight are needed to investigate this da sil ‘ 


more fully. © *. 
. Influence Upon Ratings ‘of Extraneous Factors : . ° . 8 
1 5 , 
' Tables 7-0 summarize the kesults uncovered in investigating the influence 
+  ‘*  ,- upon: ratings ‘of variables other than teachers’ classroom behaviors: Tables 7 and 8 ° 
7°, contain correlations between ratings given ‘by students and both student and teacher 
”. characteristics. In Table 7 are shown correlations computed yet the Tesponses of % 
‘ the total group of *334 students utilized in thig phase of the st Toc gnstruct 
" Table 8, means,were computed on each student shiesctertvtta varfa te for each of the 
: 18 classes. These means, .along with the Teacher Sex varfable, were correlated with _ 
# ; the aaa ratings given ‘each teacher on the ait alee ‘subscales. ; ° ik 
ek ° a 1 a ° ’ 


Many of the correlations shown in Table 7 are significant. However, their 
magnitude is not great. Cohen (1969) would describe them as indicative of effects 
of small to medium size. . Those variables which correlated signfficantly with ratings 
‘would be capable of ia ati only a small ie aaa of their variance. ead a 


5°. .. Table 5 


. : . # 7 . Z ; _) : . . 
: yt Re . Comparisons of Ratings Given Two Teachers by th same Class : a.” 
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er Grades and Testing . Materials - Personality Methods : \ 


* Mean on * Mean Ttem Mean Item 
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Bee OS A Bee Table 7 


gas“ Correlations Between StOTT Ratings and Both Student ; 
: + _ and Teacher Characteristics (N= 334)1 
4 . : ry «3 


. 4 ’ ' * 
‘ 


~ s ; 5 oe Teacher-] Grades = . ; 
. e + : A : | F Student | and- - " Per= ; 
Pine ped Variable -_ .- 2 Relat ions} Test ing] Materials] sonality] Methods : 
‘so TS = : . : * : 
| _ Student Sex (1 = Male, 2 = Female) Le | .19e* | : oF 
# : ; : ; ; — - 
( ‘Student Grade in Téacher's Course ‘ A ies 
| ." (A= 5, B= 4, etc.) : 278k 13k] 23K 19k ‘ 


\ Student Average Grade for Major Courses | - " ' 
(A #5, B= 4, etc!) «= * ‘ , S19%% oL3%* - 16** -03.. 
: Difference Between Student Grade in. : ye . . 
.08 | lee | 208% A), 
cS ee 


~~ 


Cour’se’ and Grade ‘in Major Courses?" _ 3 .16** 


+ Studént Reason for Taking Course - , , 
(2 = Wanted To, 1 = Did Not Want To). » «Ll* . 07, | .07, el 7ee | 


“Teacher Sex qa =-Male, 2 = Female) ’ 23% | | 07 | =.02 | | 2988 | 07 
SS ee ae : : a 


: Me » F 2 w no “. b g e 
f we Table 8 ‘'. /. ° ¥. 
\ - ‘ . a 7 i i a eit 4 
a a Correlations Between Mean StOTT Ratings Given .a.Teacher . . 


and Both Student and Teacher Characteristics (N = 18)! 
roe ; re ; : ; ny 


. 


, . , * Teacher 
: Student 


zs ” Per- ae 
. I ’ ie ‘ Relations} Testing s} sonality| Methods s 


Student Grade Level _ mS Ss Y .20 | -.08 | 08 [ssa | eal x 
Student Sex - , | .6gee | -.07 | ait 157% 12 
Student Grade irl Teacher's Course s -.01 i 19 _ 
: Student Average Grade for Major Courses |. .608e | -.03 | 4.21 04 


e. ‘ Difference Between Student Grade in — sate Pe li es . . 
‘ Course and Grade in Major Courses2 * fo 414 02 ” «ad 04 « 21 
“Student Reason ,for Taking Course ‘ 03 | 6438 | 08 | ~.06 | 35 


? 4Significant at beyond the .05 level ' : Pi Stele 
“.**Significant’ at beyond the .01 level : yy : : 
‘ \since hypotheses about the direction of differences were-not stated for Student ‘Grade 
Level, Student Sex and Teacher Sex, two-tailed tests were carried out for these. —For 


’ all other variables one-tailed tests were performed. . : 


2S gas 


Positive values for this variable indicated that the teacher being rated gave students 
i grades which were higher than those being received in their major subject courses. 


° ’ : . ' 


e 


. 


- were oaataterarad to edghe classes of. atudents. : . te 


, 


e: 


” Many’ of the. Sonselutions shown in Table 8 are signif¥cant and are, of rather 
large magnitude. Thus, much of the reason for the finding significant relation-. 


ships for the total group appears to be that there was a téndency for classes which - — 


gave teachers high ratings to differ from classes which gave low ratings. Classes 
‘which gave high ratings tended to be “made up of a higher proportion of female students 
and. to isiclude students who were earning higher grades. both in the rated teacher's ° 
course and in their other courses. (The correlation between these-two variables ' was 


+50.) Female teacherg tended also to be Yated higher, than male teachers. ‘Ratings * 
‘which were significantly related to Teacher’ Sex and to student characteristics were .. - 


-limited almost ere Y to the Teacher-Student —e subscale and the Person-"~ 
ality qenscain, \ : im ? . 


. 


fable 9 contains correlations Sscmsnit ods tated student ‘ratings: ‘and their 
scores‘on the Interest in School and Learning instrument. | These i ee 


spar all of dig correlations shown in Table 9 are significant at beyond 
the .05 level (one-tailed test). Students who held the most positive attitudes, 
toward Learning, toward School and toward Teachers did tend to give teachers the 


y See StOTT ratings. - i 3 : : * 
, " Table 9 
a «6 ° . ; - Fe ; 
; ‘ . Correlations Between StOTT Ratings and Interest 
’ er in School and Learning Scores (N= 161) ' 
h- 4p a oF ; , , - Je r 2 - 
"- + Interest in ae . ‘ ‘ ite Sa , . 
‘ $chool and Teach.-stud. ' Grades/ « ee: 
Learning Subscale ‘Relations.' Testing Materials ° Personality Methods 
. Learning 18** + 08 = 30KF 04 "+, 2B%% 
School hbase : . 18%* « 29R* , | 168 . 30%% 
Teachers : "358e oo. «33%* -__ 34n8' 23%* ORR 
Total Instrument ~30%R —*° . + 22K -, 36** | ~18%* | 38k . 


’ 


. of laa MeAchOrE, 


*Significant at beyond the .05 level] . 
bse at béyond the .01 level ~' 

r ® ™ - 

’ . : an ‘ ie < 
Finally, Table 10 was constructed as ‘a means of examining .the effect of the 

subject area taught ‘upon, the ratings given a teacher. The nuihber of teachers repre- ' 
senting éach subject area was felt tg be too small for a statistical’ test to be 
performed. However, informal examination of Table 10 seems to indicate that the , 
subject area taught did not have a major impact upon ratings. For subject areas in’ 
which a number of teachers were included, ratings varied rather widely ag a function. 
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s Wu ‘ ° F 
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ae ° gains ar ‘@ ‘ F _ ‘ Pr . . 
é ; ug’ 
. - one < 2 e > . 
. . . ' = 
wf Fs _. + Table 10 _? 
= ° : Mean Item Ratings Obtained on Each Subscale by 4 


All 36 Teachers in the Study 


a 


Subject Area Methods 


Mathematics +39 3.81 
of. 55 4.07 
26 3.92 
Social Science 36 4.05. 
V 60. 4.41 
° 22 3.60 ° 
79 3.65 - 
° ‘ -43 4.38 
; 94 3.73 
24 3.93 
2 .90 3.81 
. 86 3.61 . 
\ Boe : 
«. Foreign Language 4.43 
English = * 
ny % 
re : 
Science -Q7 
3 ’ 
° 3.12 
Business ° 84 
. : ‘ 14 
; oe 2 71 


“ Vocational Education 


A 
B 
Cc 
A 
B; 
Cc 
A 
B 
C 
D 
E 
F 
G 
H 
I 


Factor Analysis of the StOTT : ; - & oe 
- The present study provided saptchedl: i support for scoring the StOTT in terms, 


e 


' of five subscales. The items included on a subscale also appeared to be highly . 


similar in content. wo 
XV KC r $ . . iv 

wa. -« Howéver, it was believed possible that a factor analysis of the instrument 
might add measurably to the knowledge which hal been gained about it. Therefore, 
‘item data. from the total sample of 925 students were entered into a principal axis 
factor analysis. Squared multiple correlations wete used as communality estimates 
and iterations were carried out until convergence had been achieved. Both varimax - 
and oblique rotations were attegpted. ‘The results for’ these, in terms of nectar 

nh ease were almost identical. ar er , 


as 
. 


* Six factors with eigenvalues greater than 1.0 were extracted. Unfortunately 
the six-factor solution was not readily interpretable and. included a single-item 
factor. - This was also the-Case for the four- and five-factor solutions. The three- 
‘factor solution was interpretable.* At least five items loaded highly on each factor. 
Ih addition, the acree test (Cattell, 1966) indicated that the three-factor solution 
was appropriate. As a means of determining whether or not this solution was a : 
function of the particular factoring method used, the- three-factor solution for a 

; principals components analysis was also examined and found to be highly similar. 


2% “The three factors extracted accounted fdr a total of 40 per cent of the 
variance ¢ the 29 items. the factors oe were called: g : are 
I., Student Perception of, the Teacher (8 items)--male up of six 
° Teacher-Student Relations items and two Personality items. 

-II. +Methods and Materials (16 items)--made up of all items 
° included in Geeta and Testing and in Materials and of | awe 


most Methods ‘items. . 
III, Teacher Ability to Interes¢ Students %5 items )~-made up of aa 
‘one Personality ‘item (enthusiasm 2oe the subject eight), e . 
. and of four Methods items, =. * : s 


2 The first two factors extracted appeafed to he more general in nature than 
are the StOTT subscales. In essence, they combined similar StQTT subscales. The 
third factor, however, seemed to provide a new dimension’. The items loading hfghly_ 
on it all'had to do with a teacher's ability to interest students. Items loading 
on ‘this factor measured student opinions about the meaningfulness of a. teacher's 
lectures and discussions, the, teacher's enthusiasm for his or her subject, ‘the 
teacher's ability te stimulate discussion and the extent to which the teacher varied 
his or‘her methods of presentation. Scores obtained on this factor should provide a 

‘valuable addition to those obtained on the five StOTT subscales, f 


, 


\* ? 14 


Sh \ + = Discussion and Conclusions 
o>, ., aoe wee Oe . 


The Student Observation’ of Teachers and Teaching Techniques instrument 
‘ appears to be a highly useful one for high school tegchers.. Student ratings of a - 
‘teacher with the instrument were found to be stable over an intérval of a month. 
Students seemed capable of making ‘and repeating discriminations among the five 
© es scale points for each item., Classes ‘also were able to employ the StOTT to pick out 
‘ways in which they felt their teachers differed. The subscales of the instrument 
ee gen sense conceptually and, in? ‘Several, were found to _be_ internally consistent. 


oa : $ 
an set * the major problem uncovered in the study “of the instrument was that ehaaenta’ 
: of ditece types: tended to rate teathers differently. If the results of this part 
4 4, of .the study are replicable (and, indeed, they are similayyto those of Smith and 
ne: “Brown, 1976) it would be expected that higher StOTT ratings would be , routinely 


‘ peceived by teachers teaching students who like school .and are doing. well’ in it than — 
: : . by teachers teaching students who are "turned off''‘by school and are not doing well. 


ae , | These findings are not surprising ones. Students hs hold generally: poor . 
attitudes | toward teachers, for eae would not be expected to give high ratings 


, to individual ones. 
° - q 


. 


xf : What .the vesdTts ‘do seem to suggest is.that student observation of teachers 

. instruments should not be used to compare high.school teachers or to evaluate them. 
The types of students being taught appear to influence ratings of teachers to too 
great an extent for this. The present study has demonstrated that it 4s even possible 
fortwo similar, ‘classes taking. the same course from a teacher ke. disagree in their - 

a, tatings. . a 1 ’ , 


a ‘ ‘ 
se 2 ‘These results should not .be-viewed as negative ones ‘with respect té the, use 
° of the-StOTT by, teachers within their own classrooms, Teacherdywho are aware of 
_ the type of student they are teaching can, take factots such as student. attitudes 
. into consideration when iar ee the ST by a class; 
.- * The StOTT instrument, then, omens to be capable.of fulfilling | tive purpose 
ri for which it was constructed. _Its value lies in providing-feedback to individual: 
ie teachers about their students" opinions of their methods. The>instrument. was not - 
intended to be a device for comparing the effectiveness of teachers. The results 
Sbtained tn’ the present study indicate that it should nat. be used for this purpose, 


‘ ~t 
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: Appendix ; “ 
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oe 


Student Name _ 7 Subject’ i 


School | @ : : Date ve ie Sie he : 


* Grade - e a2 : 4? Period | aS - 

Teacher ‘Observed eee ee: _ Y ; ; ; ae 
, ‘ 7 
—. ' * ‘>, STUDENT OBSERVATION OF TEACHERS > 
; CVeraton 2) Sy Ke , 
Q ° © os ’ . 
; / aa — on ‘ . Bran 
* This form sake. sca of the “game questions. you have hae answered, _ but. ina 
~attterbat ways pape please answer’ them as honestly as possible. mr iahe 8 
‘ * 2 


. ~ , * 
: a me . 


¢ 


eo. re 


’ 


DIRECTIONS; On. the © “following page are pairs, of statements., Use these pairs of state- 
ments to show what you have observed about your teacher. ° For each question, comfare | 
‘each of the two statements. ' Which of the two statements Mnést describes your teacher? , ra 


Choose the one which does and circle its letter in the Answer column. 


. 


Examp te’ ; 7? : a ae . : ‘ *_Arswers 
° ; ‘ a? 2 ee ‘ 7 Ps . 2, 3 
waka aa pias ,of each pair is most true of your teachet? - ; ta Z 
1. re ~The teacher gives meaningful homework. = eS ot See DOF G) 
" B~The seacher is humorous. a as , ‘ a oo : _* 
* 2, “E- The teacher works hard. r- wah : ; 2. © or 'D 
D- The ie aaa is helpful.’ . : . ne we 
. - ? *» ‘ : 
3.\ E-Th¢ teacher is neat. . —  e ~ Ee ka 3. E or 


F~ The teacher gives good ledtures, 2 Ss 


The atotent who answered: question 1 1 above felt that Statement. B (The teacher 
1s, humorous‘) described his or her, beeen better than statement A (The teacher gives 


meaningful homéwork.). R 


: For ‘auiandilon: 2, ‘the student seaeriea statement ‘C (The teacher works hard.) 


waS more Erg of his or her teacher than was statement D (The teacher is helpful.) 


3 “Which statement abientits E or F, describes your ‘teacher best? To answer 
“ question 3 you would circle either E vr F in the colum “below the word Answers. 


Continue in this, way on the following page until you have answered all 
16 questions. . Zs 


4 


a 4 


oe ‘ 


. . 
: Which statement of each pair is “most: true of your teacher? ‘ ms % 
. } ae ~ 7 Answers“: < 
A 5 =. 
t id 2° * a res eo. _@ 
ae 1. F--The teacher varies manner 6f ceewea ates . ® oF. -l. F or B 
< . Be-The teacher willingly accepts constructive criticisms from 4 a ee 
. : Sate 5 e ° . a 
, «a 


« as : 

af OD D--The asdties is fair and. impartial. in dealing with ai students - BD or E 

E--The teacher stimulates distyssio : 

my . ‘ : 7 ie ’ . . . 

3. A--The teacher is willing to lp you when you need it. 3. f" or F w o 
F--Tfe teacher varies. manner of ° resentation. af , 


me 


‘with all stud&ats ‘ 


” Devghe teacher is fair ‘ 4, 


Afipart tal. de devi 


F--The*teacher varied er of 
f : 5. H--The teacher comes to class vell ds ciaieats : .5,° H or D. 
a D--The teacher is fair and impartial in dealing with #1}: students. © : niet 


~ » 
” 


6. E--The teliher stimulates" ‘dfecusetons: 


, --The teacher values student opin 
mene Bee m 


> 7 / C--The teacher. values student. sjetiel ea 
H=-The teacher comes to class. well prepared. 


a =O : ‘ 
. 8. “BY-The teacher wi] ‘lagi sevanes constructive ctiticisns fon ag 8- B or G. 
students. ~ c., @N 55 mS . 
G--Tree teacher remains gp one subject vara. until most gtudents ; 8 ; 
“understand it. i 
\?: E--The .teacher stimulate discussions. > , ‘ 9. E. or B. 
s, B-<The teacher willingly accepts constructive criticisms from . og 
le students. 5 ws se 7 ' =e i , 
; a t--The teacher stimulates discussions. ; 10. or A 
P A--The teacher is wilting ¢ th help. you when hen yas need Le. 
11\¢ F-+The teacher: varieg manner, of presentation. gy . 1l. F’ or C 
# Q--The EeeShee values student opinions. Ys , 
a 12 (c--The reached values student opinions. at me - 12. C or G 
— The teacher remains~on one subject area: until most students 
understand it. noe, ! 
13. G--The teacher remains on one’ subject area unt most students © 13. G or A 
_. understand it. . . , P ' 
A-“The teacher is willing to help you when you need it. 
é 
: f° ' ee : 
14. H-~The teacher comes to class well prepared. 14. H or B 
»B--The teacher willingly accepts constructive criticisms from ® 
‘students. ‘ ' 
15. A--The ‘teacher is willing to help you when you need it. ; 15. A or H 


H--The teacher comes to class well prepared. ; 


16. ‘D--The teacher is fair and impartial in dealing with all students. 16. D or G 
G--The teacher remains on one subject ae until most students : 
understand it. : . Bes 


